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DESCRIPTION 

MULTIMEDIA DIRECT COMMUNICATION SYSTEM INTERLOCKING WITH 
HTTP PROTOCOL 

TECHNICAL FIELD 
This invention relates to improvement of a system which enables semi real time 
communication by electronic mail or other methods and simultaneously enables 
transmission and reception of multimedia type of communication in a personal computer 
(hereinafter referred to as PC) of each cUent which is connected with WEB server through 
Internet or Intranet, by controlling each chent by HTTP protocol through WEB server. 

BACKGROUND ART 
HTTP is the abbreviation of HyperText Transport Protocol which is a 
telecommunication protocol popularly used for access to WEB site. WWW (World W^de Web) 
servers are composed to be able to activate HTTP programs, and handle data after WEB 
pages in the WEB servers get accesses from each client. 

HTTP is a software program which usually waits for accesses at the WEB server, 
and manages communication transactions between the server and the clients. Then, if the 
HTTP gets accesses from the client side, it enables users to look HyperText in WEB browser 
on the client's PC. 

CGI (Common Gateway Interface) is a common interface to execute exterior 
applications called CGI programs executed on WEB servers, 

IRC server is the abbreviation of Internet Relay Chat Server which is composed to 
enable real time and interactive message communication on the Internet. Through this IRC 
server, multi clients are able to chat on the real time base. Perfect real time chat session 
between chents on the Internet requires special server such as IRC server instead of WEB 
server. 

In the environment mentioned above, the following system (1)"'(3) are known; 

(1) Ordinary chat system on WEB (WEB chat system) 
This is so called regular "Chat" system performed on the Internet browser. This is 
well known and frequently used at the present, and enables frequent transmission 



and receipt of text messages between multi clients by activating chat function 
program composed on the WEB server. 

(2) ICQ type system 

This is an application system which is always staying in a screen of client's PC without 
running browser and always communicating through Internet with a special server such 
as IRC server, and enables real time chat between multi cUents through IRC sever. This 
type of system prevails widely, and as well as ICQ, many systems such as Yahoo Pager, 
Excite PAL, and AOL IM are used by many users. 

(3) Push Technology 

There have been systems and an application called Push Technology. It sends some 
specific information fi-om WEB^erverjto^ent'-s^^ with Internet or Intranet 

in accordance with time or rule specified by a client in advance. This system is the 
technology which can send information from WEB server to cUent's PC without running 
browser. 

However, the conventional technology does not have the following functions: 

(1) Ordinary type of WEB Ghat system 

Users have to move browser (Netscape or Internet Explorer, etc.) w ith this type of system, 
and usually chat on browser. Therefore, sughsystem does not have the function to stay 
on client's PC and communicate with WEB server in the situation of inactivating 
browser, and the function eventually to move browser upon instruction from WEB server 
and activate other applications^ and the..function_Like_ Push Technology in which WEB 
type application for Chat system pushes some specific information to the cKent side. 
Besides, the conventional WEB chat system does not interlock with such functions. 

Furthermore, since the conventional browser chat system is merely WEB server 
application activating on browser specialized in chat only, the system does not have 
such a function to stay on clientsPC and always comi nunicate with other WEB se rver 
applications in the background (while client is not conscious of it). 

In other words, the conventional system merely enables only chat on client's browser 
through simple WEB server. 



(2) ICQ type system 



Because this type of application system needs special server such as IRC server, it was 
impossible to compose a system utilizing WEB server. Therefore, this application was not 
possible to dynamically interlock with other applications in the WEB server. 
Besides, as is the most serious defect, it is necessary to go through Intranet proxy/firewall 
in order to realize real time chat (communication with electronic message) by IRC server. 
But proxy/firewaU of Intranet in ordinary corporation or governmental office is composed in 
the manner that session with special sever such as IRC server is impossible unless a system 
administrator specially sets up and "makes hole" at the proxy server so that clients can chat 
each other using special server such as IRC server. Conversely, there is no firewall or proxy 
server which allow any communication to pass through without making any hole, and it is 
necessary to change system configuration of firewall/proxy in order to communicate among 
multi clients with IRC server and the application. 

In the usual Internet server, Port 80 is assigned to the WEB application by HTTP 
protocol, and HTTP transaction is possible through this port number. But real time chat 
using special server such as IRC server does not use the port 80. On the other hand, access 
to the ordinary Internet server out of office through Intranet firom office such as ordinary 
corporation, school, governmental office is usually done through this port 80. However, 
communication using the conventional IRC server can not go through this port 80, and it has 
been a problem that any session (logical connection between transmitter and recipient) is 
not possible unless a system administrator purposely "makes hole" at the port of which 
number is 1024 or more (for example 2000 or 3000). 

Furthermore, the conventional system like IRC has possessed only a 
communication function as a main fiinction despite it always stays on the top of client's PC 
screen, .And multimedia function such as visual communication Uke TV phone, movie, and 
game in the main screen of the application, or showing graphic information, or playing music 
has been impossible. 

That is, although the conventional IRC t3rpe application has occupied some precious 
space on the client's PC screen while PC is activated and always connected with some special 
Internet server, the application has enabled only chat on such important space. 

In other words, although this type of application aims to occupy some precious space 
in the client's PC as the real portal' to the Internet/Intranet for a long time, the information 
given to the client in the space is only information in relation to chat with other clients 
which has been the most important purpose of the conventional system. 

For example, only infoimation such as who are connecting with whom or away from 
the desk is displayed on the screen. Although this space occupied by the application is very 



important space, the function to distribute multimedia information such as movie, still 
picture, music, game, graphic, and character information has not been provided. 

This has been essentially fundamental serious drawback caused by the fact that the 
conventional system is connected only with the special server through special protocol 
specialized in communication instead of HTTP protocol with WEB server. 

Besides, such system, which needs permanent connection with special server such 
as IRC server, causes a situation in which clients always connect with outside through the 
"hole" made specially. This implicitly means the problem that authorization of clients, 
identity authorization, ajid supervising/management of checking and permitting the right 
of entering/ leaving the system is impossible, because background thought is different from 
that of firewall/proxy which strictly shuts out from the inside and outside. In this sense, it 
has been a problem to approve the usage of ICQ type of communication method in such 
environment as Intranet, because it reaUy means making "hole" into proxy server . 

Furthermore, since ICQ type of system does not assume crjrptograph, if ICQ use 
crjrptograph, it is impossible to use such popular type of cr5q)tograph as SSL or SET which 
is popular and interlocking with HTTP protocol used for the communication between 
browser and WEB server. 

Besides, when the screen of ICQ type of application is used as portal, the method 
of cryptograph for multimedia information from other WEB server can not be the one 
interlocking with HTTP, and the original one should be specially developed. 

(3) Push technology 

The conventional push technology is broadcasting type service. The technology is 
always pours. information to client's PC, and does not have a system to interlock with 
communication portion like that of this invention. - There is just a system to push 
information from server to client's PC without running browser, and there is not a tool to 
communicate directly with information providers or related persons. 

In such environment, this invention solves the shortcomings of the simple chat 
communication system based on the conventional technology. And this invention is a 
telecommunication system which has very much dynamic multimedia functions in the same 
way as WEB browser to be able to go through ordinary configuration firewall/ proxy 
server. 

This invention can also automatically pick up character information, music, and 
movie from WEB server in accordance with HTTP instruction whichever browser software 
is open or not. And this invention can also display multimedia information from WEB 
server to some specific space occupied at client's PC, and enables clients to chat like 



telephone chat using the jEiinction of such a space of this application. 

DISCLOSURE OF THE INVENTION 
That is, this invention consists of application interlocking with HTTP embedded in 
each client's PC and HTTP telecommunication program connected with above mentioned 
client's PC and WEB server which has CGI interface to execute application. And this 
invention is a communication system composed of WEB server system which enables semi- 
real time chat (electronic message communication) through Internet and Intranet between 
each client and client's application interlocking HTTP. 

The second invention is a communication system, characterized by enabling above 
mentioned application to access to WEB server through HTTP communication program, 
without booting browser software of each client. 

The third invention is characterized by the configuration of both special client's 
application and WEB server in the manner that in order to enable semi real "electronic 
communication" (Chat) without booting browser at client side or using special server like 
IRC server, WEB server is used in order to pass through port 80 of proxy/ firewall especially 
for the purpose of communication with Internet fi*om Intranet. 

The forth invention is characterized by the design and combination of application 
and WEB server so that several multimedia application (game, motion picture, graph, music, 
and character information, etc.) activates on the small space of client's PC occupied by HTTP 
interlocking application. This has been the shortcoming of the conventional technology, so 
that other WEB applications can not easily run on the same HTTP interlocking application 
on the cHent side. That is why it is very much important to realize chat using WEB server 
instead of special server such as IRC server. 

The fifth invention is characterized by the function that the WEB server of this 
system is always checking the client side whether the client is connecting with the server 
or ready to chat, or whether any request or instruction is given to each cHent firom the server 
side. 

The sixth invention is characterized by the possibility of chat among multi clients 
which becomes possible when clients choose person/client (multi is possible) and send chat 
request messages and the recipients accept the request. 



The seventh invention is characterized by the configuration to be able to continually 
send several kinds of messages (weather forecast, stock price information, news, and fortune 
telling message, etc.) in the form of character to the application by the specific procedure. 



The eighth invention is characterized by the configuration to be able to activate 
another browser by clicking HTML format display which enables hyper-linkage at the 
apphcation portion in the client side. 

The ninth invention is characterized by the configuration to be able to show the 
faces and motion pictures of other party of chat and to communicate with the party like TV 
phone on the space of application at the client side by specific procedure. 

The tenth invention is characterized by the system which has "identity 
confirmation" and "verification confirmation" fiinctions which confirm whether the person 
has the right to access the WEB server when the client access to the WEB server and start 
using the client application, chatting with other clients, and taking multimedia information 
fi-om the WEB server by choosing the above mentioned multimedia functions. 

The eleventh invention is characterized by this system which has the function to 
be able to code the message in the cipher method interlocking with HTTP like SSL or SET 
which is popularly used at proxy/firewall server when the client starts by using the client 
application accessing to the WEB server and chatting with other clients and taking 
multimedia information 6*0 m the WEB server by choosing the above mentioned multimedia 
functions. 



Fig. 1 is a total illustration of the multimedia direct communication system utilizing 
Internet/Intranet; 

Fig.2 is a display portion of the client's application of the multimedia direct 
communication system utilizing Internet/Intranet; 
and 

Fig. 3 is a block diagram explaining the multimedia function. 



Fig.l is the outline chart concerning this invention. PCj — PCn is personal 



BRIEF DESCRIPTION OF DRAWINGS 



THE BEST MODE CARRYING OUT THE INVENTION 




computer (called herewith PC) of e^h client Ij-In.The PCi — PCn are composed^oj^terlock 
with HTTP, and the direct multimeUia communication application 2^ — 2n are-instalieS'iS^ 
the PC. The applications are supposed to stay on the PC for a long time while the PC is 
connected with Internet or Intranet. \ 

Each cUent is connected with Internet 12 and/or Intranet 11 and WEB server 1 
through public Hne, telephone line, and special line or LAN. 

The WEB server 1 includes HTTP communication program 13, WEB chat server 
14 which enables WEB type chat, WEB type information distribution server 15, WEB type 
Multimedia information distribution server 16, connection Hst management server 17, and 
other several WEB mail server programs. 

The application 2^ on the Client PC^ consists of the information display part 4, 
display part 3 which is h5^er- linked by HTML, and display part 5 of connected and/or 
registered members, display part 6 to simultaneously show multimedia type information 
(motion picture, stiU picture, music, graphic, character information, game, etc.), display 
part 7 of multimedia function choice, and display part 8 of the advertisement type 
message. 

The display part 5 of connecting person has a function to show whether the other 
clients PCi, the members registered before by the clients themselves, are connected with 
the WEB server 1. 

When the cUent chooses and clicks from this connecting persons list on display 
part 5 the party PCi (domain name) whom the client wants to communicate with, a 
communication request message is sent to the party PCi through Intranet/Internet 12 and 
WEB server 1. If the client In accepts it, the other window 9 is pop up and chat 
(communication of electronic sentence) starts on the pop up window. This chat is possible 
among multi clients. 

When the button of multimedia function selection display part 7 is selected, 
requested several WEB type multimedia information stored in WEB server 1 is sent and 
displayed on the display part 6. For example, when motion pictures are sent in the 
streaming status (to be able to be regenerated), whole set of this application 2 functions 
like TV set, or when games made of Shockwave, Flash, and Java, etc. are distributed from 
WEB server 1, this appUcation 2 functions like a game player. Besides, this appUcation 



can show the movement of stock price on the application 2 by receiving stock price 
information in the form of graphic information. And depending on the configuration, this 
system can be composed so that other window 10 or homepage browser software lOn can 
open. 

When so called TV telephone function is selected in the multimedia function 
selection display part 7, the picture of the counter party's face is shown on the display 
space of the said application 2 and voice simultaneously comes out. 

If the client In exists in the environment like Intranet and is connected with 
external Internet 12 through proxy server 11 including or not including firewall 11 in the 
Fig.l shown in the illustration, the client can go through the port 80. This means HTTP 
protocol can go through the port 80. 

It is possible to send several information to the information display part 4 in the 
application 2 by working with WEB type informatio n distribution server 15 in the WEB 
server 1. And it is also possible to display the information in accordance with the 
designated rule and the configuration requested by the client, by the way of sending 
information from the server system 22 which is connected with external contents 
information provider 21 through WEB server 1 and CGI interface 23. 

^ ^ WEB server 1 has connecting persons list management server 17, and it 

^interlocjcs with user management database 20 through CGI interfece 18, and is always 
managing which cKent is being connected or which client is ready to receive chat. 

Firewall/Proxy server 11 has functions of "Identity confirmation" and 
'"Verification Confirmation". These functions check in accordance with the stipulated 
procedure whether the client has the right to access the WEB server, and passing through 
the Firewall becomes possible only with effective ID and password input by the client. 

Such * Verification Confirmation" for going in and out firom the Internet/ Intranet 
etc is integrally managed and supervised by the commonly same rule for access to the 
other WEB server, not special one for the special server such as IRC. 

Because electronic message chat and multimedia information is uniformly 
handled with WEB server by HTTP protocol, the electronic message chat and multimedia 
information is able to be ciphered in the integral same cipher method like popular cipher 
SSL or SET which is interlocked with HTTP at the cipher programll'" at the 



firewall/proxy server 11 and client 1 



Besides, while the above working example is made for the case that the 
application is always connected with Internet and Intranet, it is certainly possible to 
compose the system in which each client PC accesses to the WEB server 1 through 
Internet in every internal time sqpulated before by the dial up program in accordance 
with TCP/IP embedded in the cHenV PC. 

In such case, chat itself is semi real time communication. This is because WEB 
server 1 stores the information of the ©ther party whom the client wants to chat with, and 
distributes the information to the other client PC on behalf of each client. 

INDUSTRIAL APpLICABILITY 

As mentioned above, the most characteristic feature of this invention is that a 
multimedia type communication tool integrally controlled by HTTP is deliberately 
developed in the form of one applicatio n which pe^ ctb^nterlocks with WEB server, but 
not on browser softwEire. 

Therefore, while existing ICQ type communication tool uses special protocol other 
than HTTP and special server like IRC server other than WEB server is necessary, a 
client in this system can freely chat with other clients, whether or not the client is inside 
Intranet, as long as the client exists in the environment to be able to watch ordinal 
WEB. 

And as long as there is WEB server which supports ordinary WEB, this 
application can be used as "window" for handling several types of multimedia information 
other than dealing electronic message (chat) on this application. 

That is, although the conventional ICQ type of communication application 
supposes the condition that the application is always activated on the display of client's 
PC so that chat with other client registered at the application is anytime possible as well 
as telephone and this type system is intensely promoted commercially as the "portal" to 
the Internet, the screen of this application (Fig 1-6) is not made to be able to transmit and 
receive multimedia information on the "place" of the PC as the portal because existing 
system uses a special server such as IRC server. This invention fundamentally develops 
the conventional type of application despite its appearance is similar with the 
conventional one so that this application can function as 'window' of multimedia 
information not as simple one enabling only chat by changing the working principle to 
HTTP. Therefore, while both aims to be the 'Internet portal" for clients, this invention 
increases value of the "portal" to the maximum at most. 



Because of the working principle adopted by the present invention (HTTP and 
WEB server), communication can go through almost all Intranet and Internet 
environment. Especially, in the office where many PCs are always connected with LAN 
in the form of Intranet and are connected with external Internet through Proxy/Firewall, 
epoch-making effective usage can be possible with this invention, because as long as this 
application is running on PC, communication with other clients and getting several 
multimedia WEB information are possible without activating browser and bothering 
system administrator by opening port at proxy like ICQ. 

Therefore, this invention can be powerful "Internet multimedia portal" at the client's PC 
which is always connected with external Internet world through Intranet or special Une. 

Besides, this invention can cipher in the integral manner both chat message and 
multimedia information using cipher method interlocking with HTTP ( SSL, SET etc) 
popularly used in Internet, because this invention controls both communication message 
and multimedia information by HTTP. 

On the other hand, ICQ ty^e system can not use SSL nor SET which is popularly 
used as Internet cipher. This is because this type of system uses the different protocol 
from HTTP and two different cipher methods are necessary for WEB server 
communication and chat on this type of system, which causes inconvenience that two 
types of security systems need to be prepared. In this invention system, all messages are 
handled as communication with WEB server by HTTP, and cipher can also be managed 
in integral manner of the most popular method ( SSL, SET, etc.). This means that 
security can be consistently integrated. 

_ Besides, from the security point of view, security management for whole system ._ 

can be strengthened more. This because some special port need not be opened in Proxy 
server/ Firewall, and the cipher can be consistently managed by one system which are 
used as cipher for WEB server communication, and "Identity confirmation" and 
'Verification Confirmation" are possible by integral manner exactly in the same manner 
as that popularly used for WEB server communication by HTTP. 



